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When  I'.S.  Government  drawings.  specifications.  or  ollo-r  data  an*  used  lor  an\  pur|Kise  oilier 
llian  a  definitely  related  Government  |iroeuremenl  operation.  llie  Government  lliereliy  incurs 
no  res|Minsibilily  nor  any  obligation  whatsoever,  and  llie  Tai  l  llial  the  Government  may  have 
fornmlalevl.  furnished.  or  in  any  way  supplied  the  said  drawings,  specifications.  or  oilier  dala 
i-  mil  lo  lie  regarded  liy  impliealion  or  otherwise,  as  in  any  manner  licensing  llie  holder  or  any 
oilier  |ierson  or  corporation,  or  conveying  any  rights  or  permission  in  inannfaeliire.  use.  or  »c(J 
any  patented  invention  that  may  in  any  way  lie  relaled  thereto. 

This  report  is  siihmitled  liy  the  Manpower  and  Personnel  Division.  under  Project  77.11.  with 
Hlj  Air  Force  Human  Hesources  Laboratory  (AFSC).  lirooks  Air  Force  Rase.  Texas  782 .TV 

This  rejMirl  has  been  reviewed  hy  the  Office  of  Public  Affairs  (PA)  and  is  releasahle  lo  the 
National  Technical  Information  Service  (NTIS).  At  NTIS.  it  will  he  available  lo  the  general 
public,  including  foreign  nations. 

This  special  report  has  liecn  reviewed  and  is  approved  for  publication. 


RONALD  w.  TERRY.  Colonel.  I  S  \F 
Commander 
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Requirement 

I'lic  Senior  K\«-«-nti\  ••  sal  S\-lem  (hi.  VS)  was  developed  in  response 1<>  the  requirements  <il  the 

(nil  S,n  ice  Reform  \r  l  nl  I'fTfi  and  a  Request  lor  Personnel  Research  (RPR  7(i-l4t)  snlmiiltril  In  I  In*  Vir 
I'orcc  tinman  Re-nuivcs  l.ahnratnrv  li\  I  lie  Vir  Force  Directorate  of  Civilian  Personnel.  The  appraisal 
•nil  jirn\i«li‘>  a  method  for  nhjrclivclv  assessing  tin-  performance  «f  Air  Korir  Senior  Executives. 

Sy stem  Development 

rile  Senior  Executive  A|i|  iraisal  Svslcm  was  designed  liv  integrating  information  gathered  from  a 
review  of  llie  lileralnre.  a  review  ol  existing  executive  appraisal  svslems.  anil  guidance  from  Air  Force 
executives  (mililarv  and  civilian).  The  most  imporlaul  eomponeiil  of  llie  SE  AS  i-  the  performance  plan. 
The  plan  provides  llie  exeeulives  with  ail  opporlunily  lo  list  iheir  performance  reipiiremenls.  to  designate 
whether  these  requirements  are  critical  or  noiierilieal.  and  to  assign  priority  weights  lo  the  requirements 
as  a  method  of  specifying  their  relative  importance.  The  completed  performance  plan  is  then  reviewed 
and  signed  hy  llie  executive  and  his/her  supervisor. 

At  the  end  ol  the  appraisal  period,  the  executive's  supervisor  rates  the  performance  of  the  executive 
on  each  requirement.  The  supervisor  also  renders  an  initial  overall  rating  on  the  individual.  The  appraisal 
is  then  reviewed  (the  reviewing  official  is  usually  the  supervisor's  supervisor),  and  alter  the  appraisal  is 
complete,  it  is  sent  lo  an  organizational  Performance  Review  Board  (PRB). 

A  lest  ii  the  I’RB  procedures  indualed  that  thev  were  effective  in  differentiating  between 
individual-  based  on  performance  and  that  (here  was  no  significant  systematic  discrimination  on  the  basis 
ol  race  <  r  sex.  To  operationally  distribute  bonuses,  the  Air  Force  convened  five  organizational  I’RBs  and 
one  central  I’RB.  This  configuration  of  I’RBs  was  selected  because  it  provided  the  maximum 
decentralization  while  ensuring  that  the  best  performers  in  the  Air  F'orcc  were  rewarded. 

Recommendations 

In  order  for  the  SK.AS  to  maintain  its  usefulness,  viability,  and  credibililv.  the  svsteiu  must  be 
monitored  continually  to  determine  methods  ol  improvement.  It  is  also  essential  that  the  SF,  AS  training  lie 
continually  updated  and  that  all  appropriate  individuals  receive  adequate  training. 
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AIK  FORCE  SENIOR  EXECl  TIVE  API'HAISAL  SYSTEM 


I.  HACKCKOl'M) 

In  l‘)7(>.  the  Air  Force  Human  Resources  Laboratory  ( AFHRL)  was  tasked  to  develop  an  appraisal 
system  for  all  Air  Force  civilian  employees.  Three  subsystems  were  required  to  accomplish  the  goal  of 
providing  objective  methods  to  assess  the  performance  of  (1)  members  of  the  Senior  Executive  Service. 
(2H  General  Managers  (CM  1 3- IS),  and  (3)  (General  Schedule  (t »S)  and  Federal  Wage  System  employees  in 
grades  I  —  IS.  This  report  focuses  on  the  first  of  these  subsystems:  the  design  and  development  of  the 
Senior  Executive  Appraisal  System  (SEAS),  the  SEAS  training  program,  and  other  topics  pertinent  to  this 
development.  One  of  the  primary  uses  of  the  system  will  be  to  use  the  appraisals  as  the  basis  for  awarding 
Ihhiiiscs  to  senior  executives. 

rile  specific  requirements  of  the  SEAS  arc  delineated  ill  Public  Law  *),">- !.'>f  (the  Civil  Service 
KiToriii  \cl  (CSRA)  ol  1*178)  and  guidance  provided  by  the  Office  of  Personnel  Management  (OPM). 
Excerpts  from  PL  *)S-  L>l  and  information  provided  by  OPM  concerning  the  guidelines  for  developing  an 
executive  appraisal  system  for  senior  executives  are  included  in  Appendix  A 

II.  SYSTEM  DESICN 

Review  and  Evaluation  of  Appraisal  Systems 

The  initial  step  in  designing  the  SEAS  was  a  review  of  literature  on  the  topic  of  executive  appraisal 
along  yyilli  an  evaluation  of  current  systems  used  in  private  industry  and  those  being  developed  hv  Federal 
agencies  in  response  to  the  CSRA.  A  selected  bibliography  relevant  to  the  development  of  the  SEAS  is 
contained  in  Appendix  R. 

Results  ol  the  literature  review  indicated  that  none  of  the  systems  reported  or  suggested  addressed 
'he  design  or  development  of  an  executive  appraisal  system  that  would  meet  the  specific  CSRA 
requirements.  The  emphasis  of  appraisal  systems  used  by  private  corporations  is  in  determining  which 
executive  is  best  suited  for  promotion  rather  than  in  appraising  actual  job  performance.  However,  many 
organizations  have  adopted  a  Managemenl-by -Objective  (MBO)  system  in  which  managers  specify  their 
objectives  for  the  rating  period,  with  (heir  performance  being  appraised  subsequently  on  the  basis  of  the 
extent  to  which  they  met  or  exceeded  their  goals. 

For  example,  one  company  wa-  found  to  use  a  modified  MBO  system  that  included  some  concepts 
relevant  to  the  development  of  a  system  that  would  meet  the  CSRA  requirements.  Their  system  required  a 
delineation  ol  (I)  tile  position  accountabilities,  which  are  the  expected  result-  defined  bv  a  position 
analysis:  (2)  the  objectives,  which  stale  what  must  be  planned  in  order  to  gel  satisfactory  re-nlts  in  each 
accountability:  (3)  the  standards  of  measurement,  which  will  ensure  an  objective  analysis  of  the 
incumbents  performance;  (|)  a  description  ol  (he  incumbents  actual  perlormauce:  and  (a)  the 
supervisor  s  appraisal  ol  tile  incumbent  s  overall  perlormauce  level  in  terms  of  result-  achieved. 

Among  Federal  agency  systems  developed  in  response  to  the  CSRA.  the  National  Aeronautic-  and 
Space  Administration  (N  AS  A)  had  developed  a  system  that  met  all  the  CSR  A  requirements.  Therefore,  it 
proved  to  he  an  excellent  starling  point  lor  the  development  ol  the  Air  F urce  system  cv on  though  it  did  not 
meet  the  specific  needs  of  the  Air  Force. 

The  N  AS  A  sy-  lent  provide-  lor  a  performance  plan  in  which  each  executive  designate-  at  lea-1  one 
special  objective  and  one  or  more  continuing  responsibilities  under  each  of  three  critical  clement-.  The 
critical  elements  are  management  performance,  program  performance,  and  individual  initiatives.  The 
performance  plan  also  provides  lor  a  li-ling  of  the  actions  required  by  snperv  i-or-  or  peers  to  achieve  the 
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ullHiai  and  flit*  rxcriiim*.  A  l  tfir  «tnl  of  llir  ralin^  |M*iiod.  I  Im*  ;i<  Mial  ;nliir\ fitn*ii  I  -  ol  I  Im*  i*\#*riilm*  an* 
ili'-cnhrd,  and  tlir  degree  ol  iii'liiru'inral  is  evaluated.  I  he  critical  etc  me  Ills  arc  then  rail'll  I  he  e  U1  me  III 
lit t i rifZ'  arc  1 1 1- 1 •  lit-tl  using  a  short  narrative  summary.  ami  linaliy.  an  overall  ry l i nji  is  rendered. 

Other  t.nvoriimciii  agencies  (  Vrinv;  Navy:  I )<-|iariim-nl  of  l.almr:  Department  of  Health.  Lilmalioii. 
and  Vf  oil  arc:  Department  of  tin-  Treasury:  Office  of  Personnel  Management:  and  Department  of 
Transportation)  were  contacted.  None  of  these  agencies  via>  sufficiently  advanced  in  I  In-  development  of 
its  executive  appraisal  sv stein  10  provide  a  detailed  description.  Invariably.  tin-  approach  preferred  by 
each  agency  was  a  modification  ol  the  classic  MHO  system. 


Development  of  the  Air  Foret'  Model 

Rased  on  ihe  OSRA  requirements,  the  literature,  private  industry  systems,  and  government  systems 
(aelual  and  proposed),  it  was  deeided  that  the  most  appropriate  approach  would  be  to  design  a  system  that 
incorporated  the  best  attributes  of  all  systems  reviewed  and  evaluated  which  met  the  LSRA  requirements. 
It  was  also  deeided  that  in  order  to  maximize  user  acceptance  and  ease  of  implementation,  high-level 
management  support  and  user  participation  in  the  development  would  be  desirable.  Thus,  prospective 
senior  executives  were  employed  in  every  phase  of  (he  development.  The  appraisal  system  development 
thereby  incorporated  both  substantiated  and  tried  psychological  principles  as  well  as  management 
experience  and  judgement.  Therefore,  an  initial  "strawman'  system  was  developed  and  tested. 

The  "strawman''  system  was  similar  to  the  proposed  NASA  system:  (I)  the  appraisal  would  contain 
three  performance  areas:  I’rogram.  Management,  and  Individual:  (2)  performance  requirements  would 
he  specified  ill  each  of  tile  areas  and  would  he  written  at  the  level  that  would  indicate  fully  successful 
performance:  (.'))  each  performance  area  would  have  at  least  one  critical  requirement  that  must  be 
achieved  for  sueeessful  performance  and  one  objective  that  indicated  an  area  in  which  the  executive  was 
going  to  improve;  (4)  each  performance  area  would  be  rated,  and  in  addition,  a  separate  overall  rating 
would  be  provided  In  the  supervisor:  (5)  the  executive,  the  rating  official  (supervisor),  and  the  reviewer 
(the  first  line  supervisor  s  supervisor)  would  all  be  given  an  opportunity  to  comment  on  the  rating:  and 
((>)  no  restrictions  on  length  of  comments  were  specified. 

Members  of  (lie  M  IIKI.  research  team  met  with  military  and  civilian  members  of  the  SLS  \d  Hoc 
( roup,  which  included  managers  from  the  Air  Staff.  Air  Force  Systems  Command.  \ir  Force  Logistics 
Command,  and  the  Office  of  the  Secretary  of  the  Air  Force.  The  members  of  this  group  represented  tile 
nrgani/atiun-  that  contained  more  than  'Ml  percent  of  the  authorized  Air  Force  SKS  positions.  This  broad 
Command  representation  was  deemed  a  necessity  lo  ensure  a  feeling  of  involvement  bv  the  individuals 
allecled  bv  the  sy stem. 

During  ibis  meeting,  (lie  Command  representatives  reviewed  and  modified  tile  initial  design 
propo-ed  bv  the  AFIIRI.  research  team.  Their  changes  included:  (I)  revising  the  designation  of  the  first 
performance  area  from  I’rogram  lo  Fiineliou/Program  so  that  it  would  have  more  meaning  lo  Air  Force 
executives;  (J)  -pccilving  al  least  one  critical  requirement  in  the  performance  plan,  rather  than  in  each 
performance  area  (this  change  was  made  because  the  wide  spectrum  ol  jobs  inherent  in  the  Air  Force  SKS 
might  preclude  an  executive  from  having  a  critical  requirement  ill  each  performance  area):  and  (.4) 
deleting  the  concept  of  objectives  because  it  was  felt  that  tile  most  important  aspect  of  the  performance 
plan  wa-  lo  delineate  the  responsibilities  ami  requirements  for  (he  rating  period.  It  was  perceived  as 
unrealistic  to  a"iimo  that  cadi  executive  would  be  able  to  specify  a  realistic  objective  (c.g..  reduce  paper¬ 
work  bv  1 1 Mi>)  bccau-e  ol  llieir  varied  job-. 
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111.  ^ruii|i  iiKn  '|  mm  1 1' I  ril  'i  m  H'  -v  -li-m  I  >.l  r.i  II  n-t|-r^  dm  v  pcrci-ivcil  a-  r-si-nlial :  1 1  I  limit  1 1 1 1 1  form  In  it 
-i  Mgh*  jiiiiir,  (  )  it  v  i  ill  I  .1  -\ -lorn  tliiil  I  III  IN  nil*'  .i  lal-e  st-ii-c  nl  - 1  ii  ■i'll  inlv  li\  allrihiiling  iiiiiiiitii*  score-  In 
-iiumw liat  subjective  judgment-.  ami  (■()  itlili/c  managt-iimnl  guidance  to  llii‘  rriaNiimmi  extent  possible  ill 
llii'  development  nl  tin*  sv-lcm. 

Tlre-e  parameters  ami  suggested  nimbi  malion-  Hrri'  incorporated  into  a  revised  SI.. VS  iimilrl  ami 
hrit-lt-tl  lu  llir  Vir  lour  ( IS  11  V  Winking  <.rnu|i  mi  ."i  Vpril  l<>7‘).  I  lie  (.SKA  vwirk i il(»  group  limn 
recommended  a  minor  modification  to  tin*  model:  speed  icall) .  llm  cveciiliv e-  were  In  recci vc  a  rating  mi 
rarli  performance  requirement  in  addition  In  llm  |mrlormanri'  area  rating-  ami  llm  overall  rating.  1  hi- 
rhiitij!!'  rmilil  i m  rra-r  llm  object  ivilv  nl  llm  nvi'rail  rating  because  il  |»rovi<li'<l  llm  supervisor  with  rating- 
nn  llm  -pct-ifir  individual  requirements  In  use  wlmn  making;  llm  overall  rating.  Vl-o.  il  was  thought  llial 
ibis  Ivpc  nl  rating  sv-teni  would  prov  idr  I  i-i-d  liink  In  llm  executives.  enabling  llmm  In  -ee  where  llm) 
excelled  and  wlmri-  llm)  needed  In  improve. 

Pretest  of  lilt-  Si'iiior  Executive  Appraisal  System  (SEAS) 

l  lm  revised  SEAS  model  was  tested  on  a  small  group  nl  Id  senior  executives  and  general  officers  In 
determine  llm  appropriateness  of  the  concepts,  procedures,  and  lorius.  I  lie  participant-  were  provided  a 
lull-da)  training  session  on  llm  retpiiremenls  nl  the  CSKA,  die  proposed  appraisal  svsiem.  and  llm 
develupmenl  actual  perfnrmanee  requirements.  At  the  end  nl  llm  training  session,  llm  participants  were 
instructed  to  develop  performance  retpiiremenls  and  specif)  llm  critical  retpiireiuenl'  nl  llieir  jobs. 

Tim  major  problem  iihnldmil  In  I  lie  group  was  dil  I  ieull)  in  describing  l  heir  job-  In  ”  measurable  or 
"re-ulls  oriented"  slatemenls.  However,  given  die  constraints  ol  the  law.  die)  indiralcd  dial  (be  -vslem 
ib'sigimtl  bv  VEIIKI.  was  siiilable  lor  use  bv  Vir  Force  senior  executives.  Flic  resiill-  from  ibis  trial 
provided  information  necessary  to  determine  training  retpiiremenls.  lo  refine  die  appraisal  system 
liirllmr.  and  lo  develop  the  final  SEAS  model. 

Development  of  the  Training  Program 

Mam  of  die  problems  idenlitieil  bv  die  I  mid-test  group  resulted  trom  insufficient  training. 
Therefore,  in  order  lo  prepare  Vir  Force  senior  executives  and  llmir  supervisors  to  develop  a  performance 
plan  and  lo  understand  llm  requirements  of  die  C.SRA.  a  eomprebensive  training  program  wa-  developed. 

I  be  Iraining  was  centered  around  information  contained  in  a  pre-workshop  handbook  lor  die  senior 
executives  ami  one  for  llmir  supervisor-.  After  studying  the  handbook,  dm  executive  and  supervisor 
uilended  a  workshop  in  which  application  of  knowledge  obtained  from  llm  handbook  look  place. 

Tim  handbook  for  die  senior  executive  provided  (Dan  explanation  ol  llm  legal  retpiireiuenl- ol  die 
( :SK  V  pt  ■rliimnl  lo  the  SKS:  (2)  a  description  of  llm  SEAS:  and  (H)  procedures  lur.  a-  well  as  practice  in. 
developing  an  effeelive  performance  plan.  File  handbook  designed  lor  llm  siiperv  i-ur-  convex ed  llm  same 
information  wilb  fewer  details  on  the  procedures  for  developing  a  performance  plan  and  contained  un 
prat-licc  exercise*. 

The  work-hop  lasted  a  full  tlav  for  die  -eninr  executive  anti  hall-dav  for  the  i-xeeulive  -  -uperv  i-or. 
During  die  morning  se-inn.  die  exciiilivi--  were  tii-lruclt-d  in  completing  a  perlorinanci-  plan  anti  limn 
provided  llm  opporlunilv  lo  write  llmir  own  performance  require nmuls  wilb  the  iis-i-lanee  id  llm 
facilitator-.  The  afternoon  -c»sinii  ini  lulled  llieir  supervisors,  ant)  provided  an  opporlunilv  lor  dm 
supervisor  anil  t-M-eulive  lo  tielermiim  llm  contents  of  dm  performance  plan  jninllv.  V-  in  llm  morning 
•e-sion.  fat  dilator-  were  available  lo  a-sisl  llm  participants  as  required. 

Description  of  the  Kiual  SE  AS 

Tim  SE  VS  lias  Iwo  major  rompoimnls:  die  performance  appraisal,  and  dm  1’i-rlormaime  Review 
Hoard-  (I'RIJs).  The  apprai-al  eonsisls  of  a  performance  plan  and  supervisor)  rating-.  Tim  performance 

<) 


pi. in  jmn  idr-  .1  medium  I  •  >i  (M  iilonltl  v  mg  (In'  pci  loriiiaii' c  require  mcni-  ol  tin-  cxcciiliv i‘.  (2) 
designating  critical  requirement-.  (.0  a -signing  priori  u  weigh'  -  in  i  In'  r<-< 1 1 1 ■  i <■  mi- 1 ■  I anil  (  I )  -pecil  \  iug 
au\  actions  or  re-oiii'cc-  required  lo  meei  the  requirements. 

I  hr  jn‘i /til  unlit' r  I'l'iH.  \-  tcqunid  In  I  .S 1 1  \ .  llit-  I  >•- rl  •  >  li  ■  1 .1 1 1  <<  -  | » I  .i  ii  i  -  il<‘\ i‘lo|ii‘il  In  I  tic*  laluig 
ollirull  in  rnit-ullalinii  mill  1 1 1<  ■  I'Mriilni-  a)  I  In-  }  n  ■”  1 1 1 1 1 1 1  ifi  ol  I  In-  rating  period.  However.  tin-  rating 
<•1 1  ii  in  I  niaim  linal  approval  auihoiilv  lor  1 1 1  <  |  >>■  il  •  >r  1 1 1  ;i  i  n*'  ri‘i|iiiri'ini-iil>  assigned.  Flu-  assigned 

performance  ri-»|  ii  i  ri  - 1 1 1<- til  -  am  mionli'il  in  inn-  ol  ■ )  >  n  ■>-  pt-rlnrmaucc  ;iit;i>  (-it  I'alilc  I). 

Tahir  I.  Description  of  the  SKAS  Performanee  Areas 


Fund  ion/Prograin: 


Management: 


linliviilnai: 


This  area  iiieluiies  program  planning:  program  implementation:  completing 
slmlies.  reports  ami  contracts:  developing  new  policies:  anil  program  informa¬ 
tion  exchange,  dissemination,  or  documentation,  etc. 

This  area  includes  organizing:  budgeting:  personnel  utilization  and  develop¬ 
ment:  inlernal/external  communication:  meeting  KKO  requirements; 
administrative  activities:  etc. 

This  area  inelndes  parlieipation  in  speeial  project-.  Ad  Hoe.  committees  and 
task  teams:  development  or  action  on  innovative  ideas:  professional  develop¬ 
ment.  conferences  and  seminars:  and  other  development  activities. 


I.aeh  performance  area  will  contain  at  least  one  performanee  requirement.  V  performance 
requirement  specifies  the  result  to  In-  achieved,  the  expected  level  of  achievement,  and  the  lime  in  which 
it  i  ii  Us  t  lie  achieved  for  fullx  successful  performanee.  Table  2  provides  some  examples  of  SKS 
performanee  requirements. 

Tahir  Kxamplcx  of  SKS  Performanee  Requirements 


1.  Identify  2"»  of  the  positions  with  career  advancement  opportunities  for  Project  Mainstream  In  .ill 
June. 

2.  Reverse  thi'  trend  on  rising  indirect  and  overhead  costs  and  achieve  a  ratio  of  fa /.’>.">  on  direct/ 
indirect  costs  by  30  June. 

3.  Publish  supplement  to  \KSF.R  KlHI.|(l  hv  30  \pril. 

I.  Broaden  subordinates  professional  skills  |iv  providing  each  with  two  developmental  assignments 
outside  his/her  specially  by  30  March. 


Once  the  perlormaiicc  requirements  arc  ulciililicd.  lliose  which  are  critical  arc  designated.  V  critical 
requirement  i-  anv  require mcnl  of  the  job  wImcIi  i»  -iiflicieiilly  important  that  inadequate  performance  ol 
it  outweighs  acceplahle  performance  in  oilier  aspects  ol  the  job. 

f. ai'li  performance  requirement  al-o  has  a  priority  weight  assigned  lo  indicate  the  relative  importance 
of  that  performance  requirement  to  the  total  Sl>  position.  The  total  of  the  priority  weights  must  equal 
100.  t  Critical  requirements  will  geiter.illv  .  lull  not  necessarily,  receive  a  higher  priority  weight. 
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The  li  nil  I  section  <>l  I  lie  performance  plan  (  Vcliuu/Kcsourccs  Required)  enables  tile  executive  In 
inilieute  the  actions.  resources.  ami  i ii|>nt>  from  outside  sources  that  are  necessary  to  achieve  the 
performance  requi rente tils. 

The  appraisal  svslcm  also  provides  lor  revision  of  the  performance  plan  and  feedback  to  the 
executive  as  part  of  the  normal  management  process  during  the  rating  periotl.  These  performance  rev  icw-. 
provide  the  supervisor  and  executive  with  opportunities  to  disenss  the  executive  s  perlornianec.  changes 
in  mission  rcipiircmenls.  and  the  impact  of  outside  influences  over  which  the  executive  mat  have  no 
control. 

The  ruling  process.  At  the  end  of  the  rating  period,  the  rating  official  renders  an  adjectival  rating  to 
assess  the  performance  of  the  senior  executive  for  each  performance  requirement,  each  performance  area, 
and  overall  performance.  The  possible  ratings  are  described  in  Table  f.  Ihe  performance  area  ratings 
should  not  neeessarilv  he  a  cumulative  average  of  the  ratings  of  the  individual  performance  requirement' 
lull  ilicv  should  he  liighlv  correlated.  Similarlv .  the  overall  rating  should  not  necc'-arilv  lie  a  cumulative 
average  of  the  performance  area  ratings.  Instead  it  should  indicate  the  rating  official  s  judgment  of  the 
exeeitliv  e  s  ov  era  1 1  performance.  1 1  performance  on  any  critical  element  is  considered  unsatisfactory  .  then 
the  overall  rating  must  he  below  Fully  Successful. 

Tahir  3.  Rating  Definitions 


Of  TSTANDING: 

Consistently  perforins  in  an  outstanding  manner  which  far  exceeds  the 
Fully  Successful  criteria. 

EXCELLENT: 

Consistently  performs  in  a  manner  which  is  considerably  above  the  holly 
Successful  criteria. 

FI  I.I.Y  SlCCKSSFl'L: 

Performance  was  al  the  level  which  would  normally  he  expected  of  a 
senior  executive. 

MINIMALLY  ACCEPTABLE 

Often  performs  in  a  manner  which  falls  below  the  Fully  Successful 
criteria. 

l  NSmSFACTORY: 

Consistentlv  perforins  in  a  manner  which  tails  well  below  the  holly 
Successful  criteria. 

The  rating  official  is  also  required  to  describe  the  executive’s  performance  oil  all  critical 
requirements  and  to  substantiate  all  nonerilieal  requirements  rated  l  nsatislaetorv.  Minimally  Acceptable, 
or  Outstanding  with  a  short  narrative  description.  The  narrative  substantiation  should  he  objective  and 
relate  to  the  specific  results  or  accomplishments  of  the  executive  relevant  to  his/her  performance 
requirements. 

Viter  (he  appraisal  has  been  completed  by  the  rating  official,  the  executive  is  given  an  opportunity  to 
review  the  ratings  and  to  make  comments  as  required.  Then  the  appraisal  is  reviewed  by  an  individual  at  a 
higher  level  of  management  in  the  organization.  This  higher-level  review  is  to  maximize  the  objectivity 
and  equity  of  senior  executives’  appraisals. 

At  the  end  of  the  rating  period,  the  initial  appraisal  is  completed  bv  the  rating  idlieial  and  reviewed 
hv  the  executive  ami  tin-  rev  tewer.  To  meet  the  <  !SKA  requirements,  this  appraisal  i-  then  forwarded  to  a 
Performance  Review  Hoard  (PKH)  for  review.  V  flow  chart  id  the  Senior  F.xeeuliv e  \pprai-al  Svstem  is 
provided  in  Appendix  F. 
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Development  of  Performance  Itevicw  Hoard  (l'l(B)  Procedures  , 

In  order  in  cii'inc  llic  iiio-I  cipiil.ililc  lin.inl  pun  ciluri*'  lot  evaluating  SfS  pci liiriunnrc.  \  III  It  I 
i*-\ •«•«<■<!  i Isi- 1  in  11*111  literature  on  'clei  lion  hoard'.  tin*  currciil  \ir  force  ofliccr  selection  Iniaril  ~\.-ii  iu. 
.mil  l  In*  iim*  ol  -t-lci-t  ion  ciiminillccs  in  finvali*  industry  .  Tin*  iim*  ol  I’ltB-  was  inanilali'd  In  I  In*  ( is  It  aMil 
lin  n  1 1 -i"  i-  supported  In  (In*  lili-ralnri*  anil  i •  \ i~ I i 1 1{»  management  policic>. 

I’ll.  •  nici>i  •ni|K>rlaiil  ta>k  \\a>  lo  a  of  critoria  a|>j>ro|>rial<‘  to  tin*  inw<ls  and  rrtjiiin‘ninil>  ol 

\hr  \ir  I'lirn*  lor  .h>r>.iii|t  executive  perliirmancc.  \  nidi*  varietv  nl  ilrri*-ion  criteria  ua*  initially 
einisidcred:  lio\n*v»*r.  tin*  eon.'lruints  nl  tin*  t  .SH  \.  <  tPM  guidance.  anil  Air  l*orrt*  requirements  limilcd  tin* 
choices  ol  realistic  rrilrria  In  various  diuirnsioos  of  difficultv.  iiii|iorlaurr.  and  risk.  The  rrilrria  initially 
selected  were: 

1.  I,r\rl  ol  rlforl  required  lo  accomplish  the  activity. 

2.  \niininl  of  allrnlion  rripiirrd  lo  manage  and  monitor  llir  arlivily. 

A.  Drgrrr  of  imparl  (r.g..  widrsprrad  applicability  versus  local  relevance)  ol  I  In*  arlivily. 

f.  Dollar  valor  of  lilt*  aclivilv. 

Tin*  financial  risk  involved  in  attempting  tin*  arlivily. 

(«.  Tin*  potential  for  gain  or  loss  of  organizational  or  personal  prestige  inherent  in  the  activity. 

In  addition,  tin*  scoring  procedures  developed  provide  for  an  objective  and  supportable  method  of  ranking 
I  be  executives  being  considered  by  llir  board.  "Mock""  boards  were  then  used  lo  lest  these  rrilrria  lor  llieir 
utility  and  objectivity  in  assessing  the  performance  ol  senior  exeeulives. 

The  procedures  specified  lor  use  by  these  hoards  in  scoring  the  appraisals  were  as  follows:  (I)  Kach 
hoard  member  independently  scored  the  appraisal:  (2)  The  scores  were  based  on  ihe  performance  of  the 
executive  rather  than  his/her  position:  (3)  The  board  members  were  directed  lo  consider  both  the 
performance  requirements  and  specific  achievements  identified  on  the  appraisal  so  that  an  executive  with 
low  '■laudards  and  high  rating  would  not  be  perceived  as  a  better  performer  than  an  executive  with  murh 
higher  standards  and  a  lower  overall  rating:  (4)  the  scale  used  had  a  range  of  I  lo  10  with  whole  number 
increments  and  a  score  ol  five  was  designated  as  the  point  that  indicated  average  achievement  for  a  senior 
executive:  (5)  since  each  appraisal  was  scored  by  the  entire  hoard,  minor  differences  were  expected  and 
appropriate,  hut  when  any  two  hoard  members  differed  by  more  than  three  points,  a  "split"  was  declared 
and  the  appraisals  were  rescored,  after  relevant  discussion,  bv  the  entire  panel:  ((>)  once  the  scoring  and 
rescoring  were  completed,  the  average  score  for  each  executive  was  computed:  and  (7)  the  average  scores 
were  then  used  to  rank  the  executives  being  considered. 

I'm  fm  ninm  <•  lii-iini  liim  nl  Simuliilinus.  Two  "mock"  hoard'  were  convened  to  lest  the  procedures, 
lo  determine  their  appropriateness  to  tile  \ir  force  senior  exeeulives.  and  to  verilv  llieir  freedom  from 
bias  (e.g..  again*.!  Icmalcs  and  minority  members).  The  first  board  consisted  of  two  Colonels  with  prior 
experience  in  Air  f  orce  'election  boards  ami  three  civilian  personnel  who  were  in  management  positions 
but  were  unfamiliar  with  Air  force  hoard  procedures.  Three  of  the  Ixianl  members  were  male  and  two 
were  female. 

Ihe  major  purpose  ol  tile  lirsl  "mock  board  was  lo  determine  il  the  procedure'  discriminated 
against  a  minority  group  or  females.  In  order  to  accomplish  this  task.  22  actual  senior  executive 
performance  plans  were  obtained.  I  sing  the  actual  performance  plait'  wa«  important  hccuO'i-  it  enhanced 
the  perceived  reality  of  the  procc".  Since  ratings  were  nut  available,  'imulated  ratings  and  written 
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pi-lilii  alioiis  ui'iv  added  lo  provide  a  -cl  ol  complete  .mil  realistic  pci  foi  lliancc  appraisal-  In  I  In"  ho.nil 
Kuril  appraisal  Mil.-  assigned  one  of  three  ov  i-iall  rulings  (Outstanding.  Fxcellcul.  or  !’  ill  I  y  Siioeosslul)  anil 
pi-lificulinii  iiai  |imviilril  In  -n li-tan I i;il>-  tin-  assigned  rating. 

\\  1 1 1 1  lln-  .  1 1  ■  |  >  ra  i  ~  ii  I  stratified  Inin  llin-r  rating  groups.  lirtilioii.s  iiann-'  llial  wore  obvion-ly  mail’, 
rnualr.  \nglo.  anil/or  ( I ispan it-  Mirnaini-il  were  nniilomly  assigned  to  each  group.  Hispanic  -iirnamo. 
wi-n>  iiM'ti  In  represent  tin-  various  ethnic  minorities  because  l In-  names  readily  iili-iililii-il  individuals  as 
ini-iiilii-rs  ol  a  minority  group.  Sinn-  l In-  linard  members  wore  mil  provided  any  infnriiialiini  oilier  than  the 
appraisal.  I  In-  Use  III  an  uliv  ions  ellinii  minnrilv  name  was  thought  In  lie  I  In*  innsl  appropriate  mel  hull  lor 
indicating  ellinii  backgrounds  ol  (lie  executives.  A  liriet  explanation  was  given  lo  I  In-  hoard  nieniliers  on 
the  use  ol  the  scoring  procedures.  The  hoard  seored  eaeh  appraisal  then  rank-ordered  the  executives 
based  on  the  scores. 

As  a  check  on  (lie  existence  of  am  svslemalie  discrimination  inherent  in  the  procedures,  lln-  hoard 
was  reconvened.  Fin  the  second  trial  rim.  the  'aim-  appraisals  were  used,  however.  (In-  names  were 
changed.  All  appraisals  with  female  and/or  Hispanic  names  were  given  non-minority  male  names.  Those 
appraisals  llial  originally  had  lln-  min-mimirilv  male  names  were  given  female  and/or  Hispanic  names. 

\  comparison  of  the  results  of  the  two  trials  indicated  that  the  hoard  members  were  consistent  in  (heir 
rankings  and  that  (here  was  no  significant  difference  between  the  means  of  tile  overall  ratings  of  males, 
females,  and  minority  members  (see  \ppendi\  (.).  The  board  was  consistent  in  selecting  the  same  or 
-imllar  appraisals  lo  reeomim-ml  for  bonuses. 

The  restrictions  on  bonus  distribution  were  such  that  1 1  of  the  22  individuals  considered  could  be 
recommended  for  a  bonus.  On  Day  1.  seven  white  males,  one  female,  ami  three  Hispanic  members  wen- 
selected  for  a  bonus.  Conversely  on  Day  2.  four  white  males,  four  females,  and  three  Hispanic  members 
were  recommended  for  bonuses.  Based  on  these  results,  it  was  inferred  that  no  systematic  discrimination 
inherent  in  the  procedures  existed.  However,  a  few  minor  administrative  problems  were  detected  while 
running  these  boards  and  appropriate  changes  were  made.  The  most  important  change  was  lo  provide  the 
board  members  with  some  experience  in  using  the  procedures  by  allowing  them  to  participate  in  a  trial 
run.  then  thoroughly  debriefing  them  on  their  performance. 

V  second  "mock”  hoard  was  convened  al  \ir  Force  Headquarters  to  determine  i!  actual  members  of 
the  SF.S  and  Air  Force  officers  could  cffeclivclv  use  the  revised  procedures  on  a  wide  variety  of  jobs.  I  ho 
membership  of  this  hoard  wa-  designed  to  approximate  a  true  I’KB.  Therefore,  a  career  SF.S  member  acted 
a-  president,  with  other  career  members  and  high-level  military  representatives  on  the  hoard.  The 
membership  included  three  civilian  and  two  military  representatives,  one  ol  which  was  a  minority 
member  (a  Idaek  officer!.  The  selections  of  (his  hoard  were  neither  statistically  nor  practically  different 
from  those  ol  Ihe  previous  hoard.  Ml  executives  wilh  an  outstanding  or  excellent  rating  were 
recommended  for  a  bonus  regardless  of  gender  or  minority  membership.  None  ol  the  executives  with  a 
lullv  successful  rating  were  recommended  fora  bonus.  However,  tin-  hoard  members  indicated  that  in  an 
actual  I’KB  they  would  have  requested  additional  information  for  some  eases  prior  lo  providing  a  final 
-core  for  the  executive. 

The  results  of  both  hoard-  were  then  aoalv/ed  and  the  policies  ami  criteria  ol  the  hoards  were 
determined.  The  analv-i-  showed  that  the  hoards  found  only  three  criteria  to  he  critical:  (I)  The  leve  I  nf 
effort  required  to  accomplish  performance  requirement*:  (21  flu*  amount  of  attention  required  lo  manage 
and  monitor  tin*  performance  requirement*:  ami  (if)  the  potential  lor  gain  or  loss  ol  organizational  and/or 
personal  prestige  inherent  in  the  performance  requirement*. 

\iliiiiiii*lralivel\ .  the  hoard  member*  Imind  that  both  a  trial  run  and  \cr\  detailed  instructions  were 
higldt  dr*irable.  However,  tliev  indicated  that  tin*  actual  pruce**e*  utilized  b\  the  hoard  member*  *houhl 
lie  *uf ficicnilx  flexible  to  allow  for  individual  inlonnatiun-pmce**ing  technique*. 


Based  mi  these  findings.  limit  procedures  were  developed  lor  use  In  llic  actual  I’RBs.  1  hr  suggested 
briefing  lor  tin-  PKBs  is  provided  a-  Appendix  I).  It  was  anticipated  dial  this  l»ri**f i i»j»  would  hr  modified  lo 
mrrl  llii-  specific  requirements  ol  dir  various  I  *  I  f  H> . 

(ffM'iiiliomtl  1‘RH  ('.tmsiilvruliims.  Tile  purpose  ol  a  I’llll  is  lo  make  rrrlaio  llirrr  is  cousislc ncy 
•lability.  ami  nhjcrlivilx  within  dtr  SF.S.  \  aiioo-  hoard  roof iguralions  were  considered  by  dir  l.xrrulivr 
Resource  Hoard  lor  operational  in1:  (I)  a  single  Air  Four  PRB.  (2)  livr  organizational  1  *  It  It-,  and  (4)  'ix 
PRB — dir  fi  \ r  organizational  hoards  plus  a  Central  PRB. 

The  singlr  PRB  ronrrpl  was  disriissrd  hilt  rrjrrtrd  h\  llir  Kxrrulivr  Resources  Hoard.  Air  Forrr 
1 1 1 a ii agi' nir 1 1 1  wanted  lo  drrrnlralizr  'election  as  niiirli  as  possihlr  lo  rnsurr  llir  drrisioiis  were  madr  hi 
dir  iiiosl  know Irdgrahlr  individuals  and  to  prrrludr  llir  polriltial  Idas  lo  lavor  llir  executives  visibility 
radu-r  than  thrir  prrforinanrr. 

To  drrrnlralizr  llir  selection  ol  srnior  rxrrulivrs  for  bonus  awards,  llir  usr  of  fivr  organizational 
PRHs  was  roiisidrrrd.  Thi*sr  boards  would  represent  dir  rxrrulivrs  in  (I)  llir  Offirc  of  llir  Secretary  ol 
llir  Air  Forrr.  (2)  Headquarters  Air  Forrr.  (4)  Air  Forrr  Systems  Command.  (4)  Air  Forrr  (.ogistirs 
Command,  and  (5)  all  ollirr  major  commands  not  sprrifirally  rovrrrd  hy  llir  olhrr  lour  hoards.  Thrsr 
hoards  would  identify  llir  high  prrformrrs  within  llir  group  of  rxrrulivrs  rrvirwrd  hy  rarh  hoard.  Aflrr 
llir  hoard  drrisioiis  wrrr  madr.  llir  appointing  authorities  (designatrd  hy  I  hr  Srrrrlary  of  the  Air  Forrr) 
would  dislribulr  bonuses  based  on  the  reeommendatoiis  of  thrir  PRB*. 

l  lii'  approach  was  acceptable  lo  die  Fxocutivos  Resources  Hoard.  However.  I’l.  ‘Hi-. flit  (ft  July  l*J80) 
reduced  llir  iiiimhrr  of  bonus  rligihlr  positions  from  50  percent  (llir  original  quota  specified  in  llir  ( .SR  A) 
io  25  percent.  Thru,  the  Office  of  Personnel  Management,  in  a  Memorandum  lo  Heads  of  I Irpartinrnts 
and  Agencies  dated  21  July  1080.  pro\  itlcd  further  guidance  which  slated  that  "agencies  should  generally 
limit  bonuses  lo  20  percent  of  the  eligible  career  employees."  This  memorandum  also  limited  the  number 
of  executives  eligible  for  bonuses  ol  I2"u  lo  20"«  (see  Appendix  C  lor  a  copy  ol  tin1  text  ol  the 
memorandum).  Therefore,  in  order  to  ensure  that  every  executive  would  have  an  equal  opportunity  to 
receive  the  maximum  allowable  bonus  while  maintaining  the  necessary  decentralization,  the  Kxeculive 
Resources  Hoard  decided  lo  add  the  Central  PRB  as  a  sixth  hoard.  Coder  the  new  configuration,  the  live 
organizational  hoards  would  forward  thrir  nominations  to  the  Central  PRH. 

I'lir  Srrrrlarv  of  the  Air  Force  specified  the  membership  ol  the  ( initial  PRH  -o  a-  lo  ensure  the  nio-l 
equitable  representation  of  the  senior  executives.  The  hoard  consists  ol  seven  members,  the  majority 
being  career  senior  executives.  File  president  ol  the  hoard  is  a  career  SKS  mem  her  I  rom  the  Ol  I  ice  ol  the 
Secretary  of  the  Air  Force.  Membership  af-o  includes  a  career  executive  (rom  another  agency  lo  mininii/e 
the  po'sihililv  ol  favoritism  or  discrimination  hv  the  hoard.  Ceneral  Officers  are  appointed  to  the  Central 
PRH  to  prov  ide  maximum  management  representation.  I'lir  live  organizational  hoards  are  represented  hy 
either  career  executives,  noncareer  executives,  or  genera!  ollieers  on  tile  Central  PRH.  Ibis  mix  ol 
individuals  is  believed  lo  provide  the  mo'l  objective,  unbiased,  and  representative  membership  possible. 

Kuril  organizational  PRH  muv  nominate  up  to  If)  percent  of  the  executives  it  considers  lor  a  bonus. 
All  the  executives  nominated  hv  the  organizational  hoards  are  considered  hv  tile  ( .enlral  PRH.  I  lie  (  .enlral 
hoard  ranks  the  executives  so  as  lo  ensure  maximum  equity  in  awarding  bonuses  lo  the  mo'l  deserving 
executives,  and  recommends  up  lo  2(1  percent  of  the  career  SKS  members  lor  a  bonus.  Since  the  rating 
rendered  hv  the  executive’s  supervisor  was  onlv  an  initial  rating,  the  PRH  also  recommend'  final  overall 
performance  ratings  for  all  career  SKS  members.  Flic  recommended  houu~  and  rating'  are  then  'rut  lo  llir 
Srrrrlarv  of  the  Air  Force  for  final  determination'. 


I  I 


III.  I MSU  SSION 


II"'  development  "I  mi-  SK  AS  was  arcninpli-hcd  iiiiili-r  severe  liini-  constraints  a-  specified  in  the 
<  sit  \.  Viliilr  1 1 n ■  •  .SH  A  required  dial  tin*  SI’  \S  Ik-  implemented  bv  I  October  197*).  AFIIRI,  was  not 
tasked  In  participate  in  l li*-  development  nl  llu-  appraisal  sx-inn  until  March  197*1.  Therefore.  in  less  than 
.  months.  tli«'  Laboratory  liail  In  develop  the  system  anil  llu-  training,  test  anil  modify  llu-  system  and  the 
training,  train  tin-  executives  and  their  supervisors.  and  opi-ralionalK  iinpli'ini-nt  tin-  system. 

I  lir  siqipoii  provided  to  AFliltl.  al  all  levels  id  \ir  Force  management.  int  ituling  llu-  Director  of 
t  .ivilian  I’orsonncl  and  tin-  Air  Force  (  ivil  Service  Hrlnriii  Ad  Vlorking  Oroup.  was  outstanding.  St-ninr 
executives  and  general  «l  I  iccrs  nrri'  as  ai  la  lilt'  al  all  -lages  ul  development  In  ensure  an  appropriate  sv  stem 
ss a-  di'lisi'rrd  and  that  there  «as  a  feeling  of  involvement  on  tin-  part  of  llu-  executives  and  higher  li*v «*l 
inanagi'ini-nt  in  tin'  design  of  die  SKAS. 

I'lie  inclusion  of  the  e\eeulive>  in  die  developuieiil  of  die  system  proved  to  lie  extremely  important, 
hilling  die  aelual  iinplementalion  phase,  the  individuals  who  parlieipaled  in  the  SKAS  development 
actively  supported  the  system  liv  explaining  the  rationale  for  the  various  aspects  of  tile  SKAS  to  their 
peers.  Vi  illiout  this  support,  implementation  of  the  system  max  have  been  subverted  by  passive  or  active 
resistance. 

Another  important  consideration  in  the  implementation  phase  was  the  necessity  for  high  level 
management  support.  Since  management  was  included  in  the  development.  lhc\  hud  a  vested  interest  in 
die  system  and  were  supportive.  Also,  a  letter  from  the  Deputy  Assistant  Secretary  of  the  Air  Force  for 
(  ivilian  I’er-onuel  Policy  supporting  die  new  system  was  read  al  every  SKAS  training  session.  This  letter 
made  it  clear  that  die  system  was  mandated  by  law.  approved  by  the  Office  of  Personnel  Management,  and 
supported  by  the  Secretary  of  the  Air  Force.  Support  of  this  nature  precluded  executives  from  assuming 
the  new  ~y -l«-ni  was  something  dial  would  go  awav.  could  be  ignored,  or  changed  at  will. 

I'lie  operational  training  sessions  also  provided  a  number  of  important  insights.  In  all  the  training 
session-,  the  more  accurate  performance  plans  were  developed  w  hen  the  supervisor  and  executive  worked 
together.  Although  die  executives  performed  admirably  during  die  first  hall  of  die  training  session,  the 
added  input  and  sense  of  commitment  provided  by  the  supervisor  enhanced  the  performance  plan 
developuieiil  process.  Some  si  ,iior  executives  were  unable  to  meet  with  their  supervisors  and  could  not 
accurately  specify  their  supervisor  -  expectations  and  were  therefore  unable  lo  develop  an  effective 
performance  plan  during  the  training  session. 

Some  other  very  important  lessons  were  learned  from  the  training,  file  training  wa-  designed  lo 
minimi ze  the  participation  lime  required  of  the  supervisors.  However,  some  of  the  high  ranking  military 
supervisors  fell  dial  they  did  not  receive  sufficient  information  in  participate  effectively  in  die  SK  AS.  In 
die  liilure.  training  should  be  designed  so  as  to  provide  all  participants  the  -ame  information.  This  will 
luinimi/.f  the  perception  dial  any  one  individual  or  group  is  obtaining  important  information  lo  which 
olbers  are  not  priv\ . 

Dialogue  and  feedback  m  die  training  provided  important  insight-  lo  the  In  pi'  of  appraisal  form 
executives  perceived  a-  appropriate.  Mo-t  of  the  executives  and  their  siiperv  i-or-  tell  dial  die  lorm  should 
lie  limited  lo  a  'ingle  page  while  allowing  the  flexibility  necessary  lo  address  die  wide  variety  ol  jobs 
inherent  in  appraising  senior  executive-.  The  more  elosclv  die  lorm  approximated  a  blank  -heel  ol  paper, 
die  more  acceptable  it  appeared  lo  be.  The  final  appraisal  form  is  included  as  Appendix  K. 

An  e— enlial  pari  ol  any  dvuainie  -Vslem  i-  a  well  developed,  on-going  evaluation  and  aualv-i-  plan. 
I'lie  executive-,  their  siiperv  i-or-.  and  die  |’RH  member-  mil-1  lie  given  an  nppnrlouilv  lo  expre--  their 
allilude-  toward  the  system  ami  to  provide  feedback  oil  the  operational  elleclivene—  ol  die  -v-lem.  I'lie 
adequacy  ol  the  performance  plan-  -Inuild  lie  determined  F.vcrv  lacel  ol  die  SK  AS  dial  can  lie  cheeked  or 
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inrU'tiird  -liotild  In’  I  lii'  111  liniii.il  mu  iii«a  \  In*  ti-rtl  to  i  ii  i  I  i;i  1 1 '  rhangr>  llial  v\  oil  III  makr  tin*  .S|'.  \.S  inorr 
ii-.ilil*'  .mil  an  i*|ii.tlilr  in  i'M'i  nl i\ I-.  ami  iltrir  -uprrvisor-. 


I  i'  1 1 1 1  |ii-r;i  •  i  v  1 1 1  a  I  ant  appim-al  -s-lmi  In-  drsigiiril  to  iiH'or|iorali-  appropriate  rliaii|>i'>  wlieneser 
appropriate.  I'M'i  ill i\ i-~  mu-1  know  llial  llirir  coin iih-iiI -ii{'fii';-t icjns.  ami  r<‘i| ti i ri'incn I.-  arr  bring 
roii-idrird  w  lirn  rliangr-  air  mailr  lo  inipros r  the  s»  inn.  \|i|iro|irialr  ii|nlalr  lo  I  hr  sy -trill  mas  a  I  -o  help 
In  iniiiinii/r  i  n  Hal  ion.  Il  i-  rslrrmrls  iiii|iortaiil  llial  llir  users.  llir  SKS  prrsoinirl.  prrrrisr  I  lie  -tslem  a- 
-lalilr. 


I\.  SI  MMAUY  AND  K KCOM M KNDATIO.NS 

l  lir  \ i r  I'orri*  Srnior  Kxerulive  Appraisal  Ssstrrn  (SK AS)  meets  Imlli  tin*  inlrnl  ami  l lie  Irltrrol  (In* 
t.isil  Srrvirr  Hrlorin  Art  of  I  *>TH.  The  SK  AS  proviilrs  rxreulives  an  opporluuils  lo  ronsiili  will)  llirir 
-uprrsisors  ami  lo  sprrils  llir  perforinanre  rripiirrmrnis  for  llir  iiproming  raling  prrioil.  Al  mast  one 
rripiirriiirnl  nilisl  lir  designated  as  rrilirul.  \l  llir  mid  of  llir  appraisal  prrioil.  llir  siiprrvisor  will  rati-  llir 
rsrrulivr  ami  providr  written.  olijrrlisr  jnstifiralion  for  llir  initial  rating,  l  lir  appraisals  will  hr 
forwardrd  lo  onr  ol  five  organizational  PH  IK.  These  boards  will  -elrrl  llir  lop  .’50"i  ol  llir  exrriilives  liasril 
on  prrlorinam  r.  Tin-  appraisal-  of  llirsr  imiividuals  will  ilirn  lie  ron-idrrrd  by  llir  tieulral  PHH.  anti  the 
Im'-I  prrfortlirrs  in  llir  Air  I'orrr  (approximately  2(l"«  of  llir  rxrrulivrs  in  llir  Air  Korrr)  will  lir 
rrroiiiinrmlrtl  lo  llir  Srerelarv  of  llir  Air  Korrr  for  liotuisrs. 

Thr  appraisal  -\  slrm  drs rloprt!  for  Air  Korrr  srnior  exrriilives  is  a  major,  initial  slop  in  providing  an 
olijrrlisr  -y-lein  for  measuring  rsrrulivr  perlornianre.  Tlir  initial  frrtlliark  imliralrs  llial  mo.-l 
rsrrulivr-  find  il  dilfieull  lo  statr  llirir  rrsponsibililirs  ohjrrtisrls .  However.  aflrr  they  liavr  worked  svilli 
llir  -Sslrni  for  a  svliilr.  llir  process  should  heroine  substantially  easier.  The  kry  lo  tlir  SK  AS  i-  that  il 
proviilrs  an  opporlnnils  lo  express  reasonable  rsprrlaiion-  for  llir  appraisal  prrioil  ssliilr  maintaining 
-uffiririil  flrsiliilily  lo  inrorporatr  recognition  ol  prrformani  r  oil  unauliripalril  rripiirrmrnis. 

In  orilrr  for  I  In*  SKAS  lo  maintain  its  usrfulnrss.  viahililv.  anil  credibility .  il  is  rri'oiniurndril  llial  llir 
Ofl’irr  of  llir  Air  Korrr  llirrrlor  of  Civilian  Prrsonnrl  rnsurr  llial  tin:  following  ,-lrps  hr  taken : 

I.  all  nrw  mrini  rr-  nilisl  rrrrivr  adripiatr  training  upon  rnlrring  tlir  SKS. 

-.  nrw  supervisor-  of  SKS  mrnibrrs  must  receive  ailrqualr  training. 

•K  training  sliould  hr  continually  updaird  lo  turn  tlir  nrrils  of  llir  mrmlirrs  of  llir  SKS  a. id  llirir 
supervisors. 

I.  llir  SK  \S  lioulil  hr  ronlinually  monilorril  to  ilrtrrl  ans  ssslrmalir  ili-i  i.minalioii  and/or 
drl  irienrir-. 

.1.  a  l ranking  -y*lcm  -lioulil  hr  drvrloprd  lo  rnsurr  llir  prrformaiur  plan-  arr  tjrvrloprd  and 
rrsirwrd  ai  llir  hrginning  of  llir  rating  prrioil. 

(i.  llir  PHI?  prorrd mr-  mu-1  hr  monilorril  and  rrvisrd  lo  rnsurr  maximum  ohjrrlis  its . 

i.  rripiirrd  rliangr-  -lioulil  hr  iuiplrmruird  in  a  lintels  mannrr.  and 

)?.  nirmhrr-  ol  llir  SKS  anil  llirir  -uprrs  isors  inilsl  hr  givrn  arruralr  anil  liunds  f red  hark  llial  ss  ill 
,i--i-l  I  In-in  in  participating  tTfeelivrlv  in  llir  SK  AS. 

llir  ron-ririiliou-  '.inplrnirnlalion  ol  llirsr  rrrotumruilalions  is  r.-srnlial  if  llir  SKAS  i-  lo  prrforill 
effectively  llir  liinrtion-  for  ssliirh  il  ssas  dr-ignrd. 


Hi 


L 


im  \/>/\  i.  <;i  ii»i.i.ines  urn  tiii.  hkveloi'mknt  of  a 
SI. Molt  I  Al  t  I  nvi:  AITRAISAI.  SYSTEM 


I'ublic  Law  •).>-  LA  I 

Title  l\  ol  llii>  t  lit  il  Scrv  in-  Itcform  Art  (LSRA)  Section  K)2  establishes  "a  Senior  Executive  Service 
to  «*«*'  ur*-  that  I  In*  executive  management  of  tin-  Luvernmcnl  of  tin-  l  Hi  tod  Static  is  responsive  to  the 
nerds.  policies.  and  goals  of  the  Nation  and  otherwise  is  of  the  highest  quality."  Seetioii  ft) A  requires  each 
agcnev.  in  areordanre  with  standards  established  hv  the  Office  of  Personnel  Management,  to  develop  one 
or  more  performance  appraisal  systems  designed  to  accomplish  the  following: 

1.  Permit  the  accurate  evaluation  of  performance  in  any  position  on  the  basis  of 
criteria  which  are  related  to  the  position  and  which  specify  the  critical  elements  of 
the  position. 

2.  Provide  for  systematic  appraisals  of  performance  of  senior  executives. 

3.  Kncourage  excellence  in  performance  hv  senior  executives. 

1.  Provide  a  basis  for  making  eligibility  determinations  for  retention  in  the  Senior 
Executive  Service  and  for  Senior  Executive  Service  performance  awards. 

The  (ISR  A  also  requires  that  the  agency  performance  appraisal  ensures  the  following: 

1.  On  or  before  the  beginning  of  each  rating  period,  performance  requirements  for 
each  senior  executive  in  the  agency  are  established  in  consultation  with  the  senior 
executive  and  communicated  to  the  senior  executive. 

2.  W  ritlen  appraisals  of  performance  are  based  on  the  individual  and  organizational 
inTfurinancr  requirements  established  for  the  rating  period  involved. 

d.  Each  senior  executive  in  the  agenev  is  provided  a  copy  of  the  appraisal  and 
rating.. .and  is  given  an  opportunity  to  respond  in  writing  and  have  the  rating 
reviewed  hv  an  employee  in  a  higher  executive  level  in  the  agency  before  the 
rating  becomes  final. 

The  C.SRA  further  specifies  the  following: 

1.  Each  performance  appraisal  system  shall  provide  for  annual  summary  ratings  of 
levels  ol  performance  as  follows: 

a.  One  or  more  lolly  successful  levels. 

h.  A  minimallv  satisfactory  level. 

c.  An  unsatisfactory  level. 

2.  Each  performance  appraisal  system  shall  provide  that  — 
a.  any  appraisal  and  any  rating  under  such  system  — 

(1)  Are  made  only  after  review  and  evaluation  by  a  performance  review 
hoard. 

(2)  Are  conducted  at  least  annually  . 
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(3)  In  llir  rase  of  a  eareer  appointee.  may  nol  In-  made  within  120  days 

afti'r  tin-  beginning  of  a  new  Presidential  administration:  anti 

(a)  \re  based  on  |ierforinaiiee  during  a  performance  appraisal 
period. 

(h)  Any  career  appointee  receiving  a  rating  at  any  of  the  folly 
successful  levels...  may  he  given  a  performance  award. 

(c)  Any  senior  executive  receiving  an  unsatisfactory  rating...  shall 
he  reassigned  or  transferred  within  the  Senior  Executive  Service, 
or  removed  from  the  Senior  Executive  Service,  hill  any  senior 
executive  who  receives  two  unsatisfactory  ratings  in  any  period 
of  5  consecutive  years  shall  he  removed  from  the  Senior 
Executive  Service. 

(d)  Any  senior  executive  who  twice  in  any  period  of  .5  consecutive 
years  receives  less  than  fully  successful  ratings  shall  he  removed 
from  the  Senior  Executive  Service. 

A.  a.  Each  agency  shall  establish. ..  one  or  more  performance  review  hoards,  as 
appropriate.  It  is  the  function  of  the  boards  to  make  recommendations  to  the 
appropriate  appointing  authority  of  the  agency  relating  to  the  performance 
of  senior  executives  in  the  agency. 

h.  The  supervising  official  of  the  senior  executive  shall  provide  to  the 
performance  review  hoard,  an  initial  appraisal  of  the  senior  executive's 
performance.  Before  making  any  recommendation  with  respect  to  the  senior 
executive,  the  hoard  shall  review  any  response  by  the  senior  executive  to  the 
initial  appraisal  and  conduct  such  further  review  as  the  board  finds 
necessary. 

c.  Performance  appraisals...  with  respect  to  any  senior  executive  shall  he  made 
by  the  appointing  authority  only  after  considering  the  recommendations  by 
the  performance  review  hoard  with  respect  to  such  senior  executive... 

d.  Members  of  performance  review  hoards  shall  he  appointed  in  such  a  manner 
as  to  assure  consistency,  stability,  and  objectivity  in  performance  appraisal.  . 


Office  of  Personnel  Management  (OPM)  Guidance 

In  Special  Bulletin  )l.  PPM  Bulletin  *)2<M)  the  Office  of  Personnel 
Management  provided  further  guidance  on  SES  Performance  Review  Boards  as 
follows: 

Membership  Guidance 

1.  F.aelt  performance  review  hoard  in  an  agency  should  have  three  or  more  members 
appointed  by  the  head  of  the  agency  or  by  another  official  or  group.  .. 

2.  The  supervisory  official  who  made  the  initial  appraisal  of  an  executive  should  not 
he  a  member  of  the  PUB  considering  the  appraisal  of  that  executive.  However,  this 


18 


Mif»‘rt Nir  oi.iv  In-  called  in  appear  hclorc  the  PRB  as  il  conducts  "Midi  further 
review  a-  il  linds  ih*i-i*«.-.i r A 

i.  Member-  ol  a  I’Hli  1  an  ni<  hide  all  types  ol  lfilir.il  executives  I  roil)  within  anil 
outside  l  lit*  agency.  Individuals  uliii  an-  mil  Federal  employees  may  also  serve  on 
PKR-  (c.g..  representatives  ol  a  professional  association).  Generally.  I’HII 
members  should  lir  ill  positions  i't|iii\ all-ill  In  SFS  positions.  Members  rail  include 
military  officer-  anil  iniorarrrr  officials.  lint  when  a  career  appointri-  is  being 
appraised.  a  majoril\  of  l lit*  PRB  must  lir  rarrrr  SKS  appointors. 

I.  Except  where  il  is  impossitilr  linausr  of  tllr  Irvrl  of  the  position  Viitliin  tlir 
agency,  tlir  executive  iniisl  havr  thr  opportunity  to  liavr  thr  appraisal  rev  iewed  hy 
a  higher  level  executive  within  thr  agrnrv.  This  highrr  level  executive  nerd  not  lie 
a  rareer  SKS  appointee... 

Federal  members  of  the  I’HB  should  have  eurretil  fully  sueeessful  performance 
ratings...  and  not  he  a  direet  subordinate  of  the  executive  whose  performance  is 
under  review. 

Guidance  on  PRB  Functions 

1.  Each  PRB  reviews  and  evaluates  the  initial  appraisal  and  rating  hy  the  senior 
executive’s  supervisor.  .  .  . 

2.  \  PRB  can  review  any  aspect  of  the  appraisal  process.  .  .  . 

If.  \  PRB  should  make  a  written  recommendation  concerning  an  executive’s 
appraisal  and  rating.  .  .  \o  appraisal  or  rating  is  final’  until  the  appointing 
authority  takes  final  action. 

f.  \  PRB  is  also  responsible  for  making  recommendations  to  the  appointing 
authority  concerning  individual  awards  to  be  granted  to  fully  successful  career 
appointees.  .  .  . 


I«» 
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I  Iti"  experiment  »a^  designed  to  ensure  that  tin-  members  of  tin-  "mock""  hoard  rr\  icwcd  tin  same  22 


appraisals  each  da).  I  licsc  j j »j > r*r i -a I >  urn*  divided  into  four  sets.  On  dav  one.  set  I  was  composed  of  six 
appraisal'  with  Hispanic  surnames,  set  2  was  composed  of  six  appraisals  with  Anglo  names,  set  if  was 
composed  of  five  appraisals  with  female  names,  and  set  1  was  composed  of  five  appraisals  with  male 
names.  On  dav  2.  the  names  were  reversed  so  that  set  1  was  composed  of  six  Anglos,  set  2  was  composed  of 
six  Hispanics.  set  ,f  was  composed  ol  live  males,  and  set  t  was  composed  ol  five  females.  Table  (il  provides 
a  listing  ol  the  mean  scores  and  standard  deviations  for  the  various  groups. 

Table  Cl.  Comparison  of  Means  and  Standard  Deviations 
of  Pour  Sets  of  Appraisal  Scores  by  Day.  Ethnic  Croup,  and  Sex 


Dav  I 


Dav  2 


N  \  SI) 


N  X  SI) 


■Set  1  Hispanic 

(> 

5.87  .885 

Anglo 

0  5.72 

.542 

Set  2  Anglo 

(t 

<*.28  .670 

Hispa  nil 

0  5.54 

.450 

Set  if  Female 

5 

(i.27  .080 

Male 

5  5.83 

.782 

Set  t  Male 

5 

6.05  .701 

Female 

5  6.4.3 

.805 

The  results  of  the  two  days 

were  combined  to 

minimize  the  effects  of 

practice  and  other 

stitidrv 

intervening  variables. 

The  results 

are  summarized  in  Table  C2. 

Table  (’.2.  Comparison  of  Mean  Scores  of  Appraisals 

by  Ethnic  Croup  anti  Sexa 

Mean 

sr> 

N 

1 

•if 

\nglo 

6.00 

.051 

12 

1.00* 

22 

Hispanic 

5.71 

.002 

12 

Male 

0.30 

.030 

10 

0.1  1* 

18 

Female 

6.35 

.  7  r>  7 

10 

‘'w  I* ft  rnnipiiruMr  |K‘rfor(IIUIH'«‘  anil  r.Tlm^s. 
*N«>  ~ij»nil M'iinl  iliiffTHiKr  ai  |t  <  .(I.V 


21 


.■im;.\w\  it:  si c(.i  sTKi>  bhiefinc  for  prb  members 


Wo  loo  in**: 


(insert  name  of  board  member)  Wcloonio  1o  (insert  location) 


Purpose: 

The  purpose  of  this  Performance  Review  Board  is  to  assure  the  consistency,  stability,  and  objectivity 
of  the  Senior  Executive  Appraisal  System  by  providing  recommendations  to  the  \ppointing  Authority. 
( insert  name  of  .Ip/Htinliiif'  Authority).  This  hoard  shall  recommend  a  final  rating  and  a  home,  amount  for 
each  senior  executive  considered. 

Authority : 

This  hourd  is  convened  pursuant  to  the  requirements  of  Title  Four.  Section  40.'>  of  the  Civil  Service 
Reform  Act  and  Air  Foree  Regulation  40-2  (Executive  Assignment)  subchapler  (>. 

Task: 

Your  job  is  to  evaluate  (insert  number  here)  senior  executives  to  determine  which  should  get  a  bonus. 
4 our  budget  is  (insert  amount  here).  However  you  are  not  required  to  distribute  the  entire  amount.  Tin* 
maximum  number  of  executives  eligible  for  a  bonus  is  ( insert  number  here).  Once  again,  it  is  important  to 
stress  that  it  is  not  necessary  to  distribute  bonuses  to  all  eligibles.  It  is  more  important  that  you  use  xour 
experience  and  judgment  to  distribute  the  money  wiselv. 

Hoard  Schedule: 

The  schedule  far  this  Performance  Review  Board  will  be  as  follows.  You  will  receive  a  detailed 
hrieling  which  specifies  the  procedures  to  be  used  by  this  board.  At  the  conclusion  of  the  briefing,  you 
w  ill  participate  in  a  trial  run.  The  purpose  of  the  trial  run  is  to  provide  you  a  preview  of  the  appraisals  you 
will  In*  evaluating  and  the  procedures  you  will  be  using.  The  trial  run  will  be  discussed  in  more  detail 
later.  After  the  trial  run.  you  will  be  scoring  actual  Senior  Executive  Appraisals  for  the  record.  This 
procedure  will  continue  until  all  appraisals  are  scored  and  all  differences  resolved.  The  Board  Secretary 
will  then  compute  the  final  order  of  merit  and  bonus  amounts  based  on  your  scores.  You  will  then  specify 
your  recommended  rating.  Once  the  list  is  finalized,  it  will  be  sent  to  the  Appointing  Authority  as  the 
recommendation  of  this  PRB. 

Board  Organization: 

The  majority  of  the  members  on  each  PRB  are  career  SES  personnel.  However,  the  system  wa» 
designed  to  incorporate  participation  by  non-career,  military,  minority,  and  female  personnel.  All 
Performance  Review  Boards,  except  the  one  at  Air  Force  Systems  Command,  will  have  five  members  —  a 
president  and  four  panel  members.  The  A  ESC  board  will  have  nine  members— a  president  and  two 
panels,  with  each  panel  having  four  members. 

Eligibility  Criteria: 

In  order  for  Senior  Executives  to  he  eligible  for  a  bonus,  thev  must  he  career  members  of  the  SES. 
The  executives  must  have  received  an  initial  rating  from  their  supervisor  of  Fullx  Successful.  Excellent, 
or  Outstanding:  and  they  mist  have  I . .  in  the  system  for  at  least  120  days. 
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Appraisal : 


I  he  *>1  .>  petloliuanff  appr.li-al>  uni  v\  1 1 1  lie  rev  n-«  l  Iifi  have  two  inapn  components:  (a)  tin* 
I'l  l Iiimimik  I-  1*1.111.  and  lid  •  In-  |iis( il i<  at uni  unit  ruling.  in  order  In  provide  some  eoiihiiuilv  ami 
standardi/alioii.  die  perloriuauff  |il.tn  is  divided  min  three  pc f  ioriitaufe  urcai — I'  uiietioii/l*rograiii  in 
which  •In-  r xeciili\c>  'tmnlii  lot  requirements  relative  In  tin*  programs  or  other  endeavor-  fnr  which  thev 
•iff  responsible.  Management  in  which  they  li-l  -upcrv i-orv  nr  other  management  r< -~  |  in  i  >  - 1 1  >  1 1  i  I  i< .  anil 
1 ndiv  ill  ual  m  w  Inch  l  In*  »•  \ff  ul  i\  f  'I  mu  It  I  Ini  I  In-  I'fijiim- me  lit-  uniijiif  In  linn  nr  In*  r.  nr  sc  1 1  -luiprov  fulfill 
endeavors.  Al  least  nin*  pe rlni  ni.nii  f  icipiiirmeiil  should  In*  specified  Inr  each  |n*rlnnnaiiff  ari*a. 
I’f ilnriiianif  |{eqiiire inenls  should  In*  ohp*<  live  speettiealinii.s  nl  results  In  In*  achieved  li\  iln*  executive 
liming  tin*  rating  period.  l.ai  li  pc rlnrinaiiff  jilan  inu-l  contain  al  least  uni*  critical  requirement.  \  critical 
ri*i|inrf  nn*  ill  is  ilfliiifil  a>  any  ri*i|iiirf  me  nl  nl  i  In*  jolt  which  is  Mill  icic  ntlv  iiii|inrlant  llial  inadequate 
|*f rlnrinaiiff  nl  II  outweighs  acceptable  pc rlnrinaiiff  in  nlln*r  aspects  nl  tin*  job.  Iln*  |M*rlnriiiaiifi* 
require infills  an*  also  weighted  In  indieali*  llirir  relative  priority  nr  importance.  Tin*  >11111  nl  iln*  weights 
111  u>l  fijnal  l(K).  I  In*  evaluation  |>rn\ulf<l  li\  iln*  supervisor  will  fniwnl  nl  a  rating  nl  I  nsal  isfae torv . 
Minimally  Acceptable.  I*  nils  Successful.  Iah*  Ilf  nl.  m  Oui'ianding  Ini  cadi  (if  rlnrinaiiff  requirement  ami 
an  n  \ frail  ruling.  I  In*  rating  pruv  nlfil  li\  iln*  Miperv  i>nr  i-  an  initial  rating;  \nn  will  In*  recommending  tin* 
I  mill  rating  In  tin*  appointing  aiilhorilv.  \  wrilifii  pi.slilieatioo  I » \  tin*  Mipe  r\  isor  Inr  iln*  ratings  ni  each 
|n* rlnrinaiiff  requircnif nl  slmnld  also  In*  included.  W  h«*n  ri*\  icwing  iln*  appraisal.  vnn  shnuld  consider  the 
criticality  and  priority  weight  nl  iln*  pc  rlnrinaiiff  require  infill-  along  with  (heir  ratings. 

Kv  ablation  Process: 

In  nrdf r  In  elleelivclv  and  objectively  evaluate  iln*  executives.  each  nl  \ou  will  individually  score 
each  appraisal.  These  individual  scores  should  lit*  determined  without  am  discussion  hftwffi)  or  among 
iln*  various  hoard  mrinbfrs.  llu*  hoard  prfsidfiil  shnuld  also  score  faili  appraisal  in  ordfr  lo  be 
acquainted  with  tin*  performance  nl  all  the  executives.  When  scoring  llu*  appraisal,  vnn  should  base  your 
dfi  i-inii-  mi  llu*  performance  ol  llu*  executive  rather  than  his  nr  her  position.  A  011  should  fonsidcr  the 
pfrlnrinaiiff  require incnls  >pffiin*d  in  the  plan.  a>  well  a-  tin*  executive's  achievements  identified  in  the 
jii'lil icalinn  section  of  llu*  form.  In  some  inslancfs.  the  planned  performance  requirements  max  lie  so 
dillienll  that  merely  meeling  I  lie  in  would  lie  a  greater  accomplishment  than  those  rated  as  outstanding  for 
other  executives.  Smile  criteria  you  should  1  onsider  w  lieu  scoring  tin*  appraisals  are  (al  the  level  of  effort 
required  by  the  executive  to  meet  the  performance  requirement  and  accomplish  the  results  indicated,  (b) 
the  amount  of  personal  attention  required  to  manage  and  monitor  the  results,  and  (e)  the  potential  for  gain 
or  loss  ,,f  organizational  or  personal  prestige  inherent  in  the  performance  requirements.  A  form 
(  Attachment  I)  is  supplied  lor  your  Use  to  evaluate  the  executive  against  these  criteria.  The  form  is 
intended  a»  an  aid.  hut  von  need  not  use  it  if  von  do  not  wish  lo.  Once  again,  it  is  important  to  stress  that 
v our  maturity .  judgment,  and  experience  are  the  most  important  factors  in  determining  the  overall  score. 

Scoring  Scale: 

\s  mentioned  earlier,  vonr  task  i'  lo  recommend  senior  executives  lor  bonuses  liv  aligning  them  in  a 
relative  order  ol  merit  A  oil  will  do  llii-  liv  using  the  scoring  scale  on  this  slide  (  Attachment  2).  rather  than 
by  Using  a  more  complicated  ranking  procedure.  As  von  can  see.  tin*  scale  ranges  from  I  to  10  with  whole 
number  increments.  A  oil  -lioiild  Use  a  value  ol  five  as  vonr  assessment  ul  the  average  executive’s 
achievement.  Those  clearly  above  average  should  receive  a  score  in  the  higher  range  and  those  below 
average  should  receive  a  score  in  the  lower  range.  While  this  and  similar  scoring  scales  have  proven 
lhemselve»  over  the  years,  the  major  pitfall  von  need  lo  avoid  is  central  tendency:  that  is.  using  onlv  two 
or  three  closelv  related  scores  lor  most  of  the  appraisals.  In  essence,  a  hoard  memher  who  does  this 
heroines  a  constant  in  tile  scoring  process  and  is  deferring  his  or  her  decision  making  authority  to  the 
other  hoard  members. 
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I'riHi'diirfs: 


Since  rat'll  appraisal  t-  -•  mi  ll  In  tlir  rnlirr  hoard.  llirrr  arr  usually  miiiiii  dillt-ri-net—  In  s<  ores 
between  members.  These  iniiiiir  diflrrrnrrs  arr  rxprrlcd  anil  a|)|irn|irialr.  However.  whenever  llir 
diflcrriirr  between  ill*-  mum''  nl  am  two  Imaril  members  i-  greater  llian  llirrr  |»oi iil>.  a  splil  lia>  occurred 
and  lilt*  appraisal  nmsl  hr  restored.  allrr  rrlrvanl  discussion.  In  tin-  rnlirr  hoard.  Onrr  all  thr  scoring  and 
riMorillg  havr  hrrn  roinplrlrd.  I  In-  hoard  st-rrrlarx  {insert  iiiimr  line)  will  rnmpnlr  I  In-  average  Miin-  of 
i-arh  i-M-rnlivr.  This  average  hoard  srorr  will  hr  usrd  lo  rank  I  In-  executive-.  and  dcti-rminr  I  In-  ordrr  ol 
inrril.  Onrr  I  hr  ordrr  of  nirrit  is  asrrrlainrd.  I  hr  hoard  w  ill  use  il  lo  drtrrininr  w  liirh  executives  will  get  a 
honns.  If  then-  is  no  >uilahlr.  obvious  ruloff  point,  tin-  hoard  ina\  award  up  lo  ( insert  number  here) 
rxrinlivrs  a  honns.  If  two  or  niorr  individuals  arr  tird  at  l In-  point  drlrrniinrd  In  thr  hoard  lo  hr  the 
approprialr  ruloff  point,  thru  I  In-  I  it-  nmsl  hr  broken  In  litis  rirrunistanrr.  thr  pant-1  members.  untlrr  the 
dirrrtion  of  thr  hoard  president.  will  disruss  thr  appraisals  of  I  lit-  executives  involved  and  rank  thrill  lo 
tlrlrriiiinr  lilt-  final  ordrr  of  inrril.  Onrr  these  tasks  arr  roinplrlrd.  this  I’llH  will  havr  rtimplrlrd  tin¬ 
t-valuation  prorrss. 

President's  Duties: 

Although  {insert  mime  hen)  as  the  hoard  prt-sidt-iil  is  nt>l  generally  roiisidrrrd  a  scoring  mrinhrr  ol 
llir  hoard,  wr  strongly  suggest  that  ( insert  "lie"  nr  "she")  personally  srorr  all  I  hr  appraisals  lo  ensure  a 
lamiliaritv  with  rarli  individual  being  considered.  However,  in  certain  circumstances,  the  hoard  prrsidrn! 
is  rrtpiirrd  to  suhslilulr  for  a  hoard  mrinhrr  and  arluallv  srorr  llir  appraisal  lor  llir  record.  Thr  president 
iniisi  srorr  if  the  appraisal  of  a  hoard  mrinhrr  is  bring  ronsitlrrrd  or  if  llir  siiprrv  i*or  or  a  suhordiualr  ol  a 
board  member  is  being  considered.  This  is  lo  ensure  that  I’RH  members  arr  mil  rrtpiirrd  lo  score  their 
own  appraisals  nor  I  hose  of  iheir  supervisors  and  employees.  The  hoard  prcsideul  is  also  responsible  for 
directing  the  discussion  of  llir  board  w  hen  resolving  splits  or  breaking  anv  lies  that  may  rxisl  at  the  cutoff 
point.  If  a  situation  arises  where  llir  1’H It  is  unable  lo  resolve  a  dispute,  even  after  lengthy  discussion  anti 
numerous  restoring  attempts,  then  it  is  the  responsibility  of  llir  hoard  president  Iti  rest  ore  the  disputed 
appraisal  using  ( insert  "his”  nr  "her")  personal  knowledge,  experience,  and  judgment.  Any  decision 
math-  by  the  board  president,  in  this  rirrunistanre.  will  he  final. 

(it-itei-ul: 

If  lilt-  special  case  arises  when-  one  hoard  member  anti  the  hoard  president  are  ineligible  lo  score  an 
appraisal,  then  the  average  score  of  the  remaining  three  hoard  members  will  he  Used  lo  determine  the 
exrenlivt-  s  merit  score.  Also,  it  is  the  prerogative  of  ibis  hoard  to  use  anv  additional  information  deemed 
necessary  lo  effectively  evaluate  a  senior  executive’s  appraisal.  Von  may  waul  lo  have  informal 
discussions  with  ( insert  mime  Imre),  the  appointing  aulliorilv .  lo  ensure  common  objectives.  Once  lilt- 
order  ol  meril  is  finalized.  the  hoard  seerelarv  will  compute  the  approprialr  homines  based  on  a  lormula 
approved  hv  the  Kxeeulive  Resources  Hoard.  Alter  voo  have  had  a  rlianee  lo  review  the  lionii-  amuunlv 
voiir  task  will  he  lo  recommend  a  final  rating  of  Outstanding.  Kxeellenl.  or  l  olly  Successful.  An  executive 
receiving  a  final  rating  of  Outstanding  will  he  authorized  a  bonus  of  up  lo  20""  til  his  or  her  aeulal  base 
pay:  whereas  an  exeeulive  who  receives  a  final  rating  of  Kxeellenl  may  receive  a  bonus  op  to  I.Vuof  his  or 
her  base  pay.  and  the  exeeulive  rated  Fully  Successful  mav  receive  up  to  10""  ol  his  or  her  hast-  pay. 
Remember,  even  though  this  hoard  is  authorized  lo  award  up  lo  {insert  number  here)  bonuses,  there  is  no 
rripiircmrnl  that  all  eligihles  he  awarded  a  bonus.  Il  is  much  more  important  that  vou  use  your  budget 
wisely  and  reward  those  executives  who  arc  truly  deserving  of  a  reward.  The  Secretary  of  the  Air  Force 
has  taken  a  personal  interest  in  the  I’RH  process  anil  has  written  the  following  letter,  from  which  I  quote: 
(Reatl  Idler). 
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Trial  Him: 


\\  r  haw-  mini  inn. -il  ilia-  Inal  run  prcv nni-lv .  ami  al  1 1*  i  >  linn-  I  would  liki-  In  give  Min  more 
i  ill  ainii.il  lain  nn  hnw  I  lull  nin  isc  acluallv  operate'.  Alter  I  In-  I  irii-f  i  i  ■{£- .  m-  will  ailjniirn  In  I  In-  scoring 
tailin'  al  which  limn  mhi  will  In-  given  Hm-  trial  run  appraisal'.  These  a|i|iraisal'  have  linnn  carcfnllv 
'circled  In  represent  ilia-  lull  sperlrum  nl  i|  na  I  i  I  \  I  ruin  ilia-  la-a-l  In  ilia-  best  i|iia!il  inti  executive.  Wr  will  ask 
>nu  In  score  I  ha — i-  appr.ii-.il'  without  di'eiissinu.  a-  Mill  would  during  llm  iniriiial  linaril  process.  However. 
Inr  ihrsi-  Inn  a|i|irai>als.  van  iln  suggest  ilia)  Mill  lakn  linin'  ii-ing  llm  Inrin  |irovi<lml.  Alter  a  break  we  will 
have  m m r  scores  posted.  Vl  llial  limn,  wr  will  a»k  >nn  In  'liari-  \niir  ralinnaln  Inr  -curing  the  fi% a* 
appraisals.  Tim  |iur|ni'n  nl  t  li  ■>  rnm-n  i>  in  help  each  nl  miii  i-stahlii-li  vnur  nun  imliv ill  na  I  scoring 
slamlaril.  as  wa  ll  as  a  hoard  scoring  -laudaril.  Tim  major  purpose  nl  this  exercise  is  In  ensure  consistency. 

IVrfnrmumn  Hnvinu  Hoards  urn  a|i|ininlnd  In  select  llm  mnsl  deserving  individuals  rega rillnss  nl 
nummand  ul  assignment  nr  position.  \X  Imn  making  runnmmnndaiiniis.  kni-ji  in  mind  llial  >ou.  as  a  board 
nmmlmr.  am  representing  tin-  Air  Form  al  large.  Nun  worn  scli-nted  because  yon  am  senior,  malum, 
experienced  individuals.  Kai'h  of  you  lakes  an  naili  In  serve  wilhoul  prejudice  nr  partiality,  having  in  view 
hnlli  the  spenial  fitness  ul  the  executive  concerned  and  the  ef firienrv  of  the  I  niteil  Stales  Air  Fume.  VI  hen 
you  enter  this  hoard  room,  you  are  expected  In  lake  antioiis  which  are  in  the  interest  of  the  Air  Forc  e  as  a 
whole  and  not  any  one  parlieular  eommaml.  While  here,  you  are  working  lor  llm  Smrelarv  of  the  Air 
Fume  with  (insert  mime  <>/  Hoard  President  here)  In  guide  \ our  arliou. 

The  names  of  I  he  individuals  comprising  the  nmmhrrship  ul  llm  hoard  will  In-  puhlii  ly  relnased 
when  llie  selerlinn  list  is  anuimneed.  However,  the  wav  linaril  memhers  vuled  nn  an>  parlieular  ease  and 
the  ground  rules  which  llm  hoard  established  in  making  its  selections  are  priviledged  information  and 
may  mil  he  disclosed.  Lists  of  names  of  individuals  selected  nr  mil  selected  and  statistics  of  the  board's 
results  by  any  particular  group  will  not  be  maintained  by  you  and  your  knowledge  of  them  will  not  be 
disclosed  to  anyone.  There  is  no  prohibition  on  disclosing  within  the  Air  Force  community  such 
information  as  the  overall  numbers  considered  and  selected,  the  manner  In  which  the  hoard  wa- 
organized,  llm  general  procedures  it  followed,  or  the  number  and  grade  of  its  membership.  However,  it  i> 
vnur  responsibility  to  ensure  that  objective  decisions  are  made  and  the  actual  workings  of  the  board 
remain  confidential. 
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f/*/7.7V/i/\  G.  OI*M  Cl  IDEI.INK  ON  SES  BONISES 


In  a  memorandum.  dated  21  July  1780.  In  the  Head."  id  Departments  and  Agencies.  I 
(  ii  i  n  | » I  x  ■  1 1 .  (lit-  Director  of  (hr  Office  of  Personnel  Management.  stated: 

The  Office  of  Personnel  Management,  with 
the  advice  of  other  agencies,  has  prepared  the 
following  guidance  in  respect  to  awarding 
Senior  Executive  Service  performance  awards 
(bonuses).  In  part,  this  guidance  reflects  the 
appropriation  act  limitation  restricting  the 
proportion  of  SES  members  who  mav  receive 
bonuses  to  no  more  than  25  percent  of  the 
number  of  SES  positions  in  the  agency.  In 
addition,  we  are  responding  to  strong 
Congressional  concern  that  the  25  percent  In- 
viewed  as  a  ceiling.  We  are  ihreforc 
enunciating  guidance  on  the  number  and 
distribution  of  awards  which  we  strongly 
recommend  agencies  to  follow.  GAO  in 
cooperation  with  OPM  has  been  directed  by  the 
Congress  to  do  a  thorough  study  of  bonus 
payments.  Any  agency  which  chooses  to  award 
bonuses  in  excess  of  the  number  or 
distribution  recommended  below  must  consult 
in  advance  with  the  Director  of  OPM. 

1.  Number  of  Awards 

Agencies  are  limited  in  payment  of  bonuses  to  a  maximum  of  25 
percent  of  SES  positions.  The  Congress  has  made  it  clear  that  the  25 
percent  figure  is  to  be  a  limit,  not  the  norm.  Agencies  should  generally 
limit  bonuses  to  20  percent  of  the  eligible  career  employees.  If  the 
agency  head  feels  a  higher  proportion  is  essential,  he  or  she  must 
consult  with  the  Director  of  OPM. 

2.  Distribution  of  Awards 

In  deciding  the  amount  of  bonus  to  be  paid,  agencies  with  100  or  more 
career  Senior  Executives  should  not  exceed  the  limitations  shown 
below.  These  limits  cannot  be  rigidlv  applied  in  small  agencies,  but 
should  Im-  considered  as  general  guidelines. 

(a)  Bonuses  of  20%  should  be  limited  to  no  more  than  5%  of 
those  receiving  bonuses. 

(b)  Bonuses  of  17-20%  should,  in  total,  be  limited  to  no  more 
than  10%  of  those  receiving  bonuses. 

(c)  Bonuses  of  12-20%  -hould.  ill  total,  be  limited  to  no 
morethan  25%  of  those  receiving  bonuses. 
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Ir.  Man  k. 


■V  Ceneral  Procedural  Recommendations 


(a)  One  area  about  which  a  number  <>l  legislators  were 
concerned  »a-  the  |ierce|ilion  that  inenihcrs  ol 
Performance  Review  Hoards  would  he  taking  care  ol 
themselves  anil  their  Iriends  in  the  awarding  ol  bonuses. 

Vie  do  not  believe  that  this  concern  has  substance,  but  to 
further  add  to  the  object!  vilv  ol  the  review  process,  an 
agency  inav  wish  to  include  on  its  PKII  panel  one  or  more 
members  from  another  Federal  agency.  OP\|  will  maintain 
a  list  ol  experienced  career  Senior  l.xccnlives  who  could 
serve  on  I’HH's  across  agency  lines  if  the  agency  so 
retpiests.  This  same  procedure  might  well  he  useful  in  the 
future  in  passing  on  proposed  nominations  for  Meritorious 
and  Distinguished  Presidential  Rank  within  an  ageuev. 

(W  Kadi  agency  should  publish  a  notice  in  ill e  Federal 
Register  of  the  agency's  schedule  for  awarding  bonuses  at 
least  I  f  days  prior  to  the  dale  on  which  the  awards  will  be 
paid. 

(c)  Career  Senior  Kxeeulives  are  eligible  for  both  bonus  and 
rank  awards.  In  general,  agencies  should  avoid  giving 
multifile  a  tea  ills  to  a  single  Sh'S  member  in  a  rear. 

The  SKS  system  provides  agency  management  with  an  unprecedented  level  of  discretion.  It  is  vital 
that  this  discretion  be  used  responsibly  to  establish  a  sound  foundation  for  the  future. 
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